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When several sensors are concurrently scanning the same 
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1. Introduction 



The problem we consider concerns estimation of per- 
formance characteristics of sensors, based on historical sensor 
reception data. We shall imagine the sensors are "receivers", 
passively listening for "signals". If only one receiver is 
turned on, an operator might believe his receiver is detecting 
all of the signals that occur over time; he would have no data 
indicating otherwise. If a second receiver were turned on, to 
operate concurrently with the first, the operator might notice 
that sometimes one of the receivers detects a signal the other 
receiver does not, and vice versa. This implies there are 
signals occurring that neither receiver detects, and the de- 
tection probabilities for the receivers are less than unity. 

Suppose k receivers operate concurrently and a record 
is kept of the signals detected by each one. It is assumed 
that the times of detection, and perhaps the nature of the sig- 
nals detected, makes it possible to determine when detections 
on several receivers are detections of a common signal. It is 
convenient to imagine the data collected from the detection 
history with k receivers are in the form of k-dimensional 
vectors, one vector for each signal detected. The components 
of such a data vector are zeros (for "non-detect") and ones 
(for "detect") , each component corresponding to a particular 
receiver. Thus, for example, the sum of components of a data 
vector for a given signal would be the number of receivers that 
detected that signal. Note this sum must be at least 1, since 
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otherwise one would have no knowledge a signal occurred and 
hence there would be no related data vector. Of course, signals 
may occur that no receiver detects; we will be interested in 
estimating how frequently this occurs. 

We wish to use the set of data vectors observed over 
some period of time to estimate detection probabilities of the 
receivers, and perhaps to estimate characteristics of the sig- 
nal process, such as the distribution of signal strength and 
the total number of signals occurring in the period in question. 
Various estimation principles, such as maximum likelihood, 
method of moments and least squares, can be used in the context 
of various models for the signal detection process. Thus there 
are a number of candidate models and estimators which could be 
used for the problem we have described. The purpose of this 
report is to develop several estimators that could be used for 
this problem; a later report will compare their behavior under 
varying conditions of the signal process. We also give a brief 
review of the literature related to this problem and discuss 
associated topics such as intraclass correlation of the 
receivers and possible effects of dependence among the receivers. 

2 . Related Literature 

The problem we consider has some similarities to the 
capture-tag-recapture methods used to estimate wildlife popu- 
lations. The initial capture of an animal is analogous to the 
detection of a signal by one receiver; subsequent recapture of 
that animal is analogous to detection of the same signal by a 
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second receiver. The presence of a tag on a recaptured animal 
makes it possible to determine whether the two "receivers" have 
"detected" a common "signal" . There is a well established lit- 
erature on this and related methods of wildlife population es- 
timation, and these methods might be useful for the case of 
k = 2 receivers. (See, for example, Cormack (1972) for a 
review of capture-recapture methods and a good bibliography on 
the subject.) 

Applications of the methods we discuss can be made in 
a wide range of situations. It could be used to estimate the 
number of errors in computer software which is checked by 
several independent testers ("receivers"). The models have 
been used in connection with visual scanning of film containing 
images of particles occurring in a bubble chamber, with several 
film scanners acting as "receivers" (Sanathanan (1972) ) . The 
application to receivers detecting signals was investigated by 
Knorr (1979) ; one of the methods we discuss below is developed 
in Knorr 's report. I am indebted to Professor Knorr for sug- 
gesting this problem and for providing suggestions and support 
during the course of my work on the problem. 

3 . The Model 

Suppose signal strength varies randomly from signal to 
signal, so that receiver i detects signal j with prob- 
ability , independent of other signals. Let the random 

variable Vj denote an index of the "strength" or "detect- 
ability" of the j;^ signal, where 0 1 < 1 with 
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probability 1. 
signal strength 



Assume the probability is related to 

Vj through some receiver specific function 
* 



. That is, , where is the outcome on 

Vj . We suppose the receivers are conditionally independent, 
in the sense that, given V = v , the joint probability of a 
given vector of detect-nondetect components is the product of 
the marginal probabilities for each individual receiver. 
Symbolically, 



( 1 ) 



P[z = z |v = v] = TT P[Z^ = z^ |v = v] 

i=l 



= TT T . (v) ^ (1 - T . (v) ) , 

i=l 



where Z is a random k-vector whose components Z^ represent 
the individual detect/non-detect events that will occur on the i th 
receiver and z and z^ denote points in the sample spaces 
of Z and Z^ , respectively. Thus Z^ is a Bernoulli random 
variable and Z is a vector of conditionally (given V) inde- 
pendent Bernoulli components. For an arbitrary (future) signal 
strength V , let denote x^(V) and tt^ = t^(v) (i.e., 

drop the second subscript on when it carries no information) . 

Let S denote the sample space of Z , so S contains 
k. 

2 k-dimensional vectors of zeros and ones. (We include the 
zero vector, 0, in S , even though it cannot be observed as 



A list of the symbols used in this report is given in the 
Appendix. 
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an outcome on Z , for reasons described above.) The uncondi- 
tional probability of observing an outcome zeS is obtained 
by integrating (1) with respect to the marginal distribution 
F of V : 



( 2 ) 



1 

p2 = p [2 = z] = / P[Z = z|v] dF(v) 

0 



= E 



■ k 

7T 

i=l 



T^(V) 



(1 - 



T^(V) ) 



1-Z‘ 



where "E" denotes expectation with respect to V . By the 
conditional independence assumption (1) , the unconditional 
marginal probability the i;^ receiver detects a randomly 
selected signal is 

1 

(3) 7T^ = P[Z^ = 1] = / T.(v) dF(v) . 

0 ^ 



One could consider several forms of the detection 
functions for receiver i; i=l,2,...,k, including the 
following : 



(a) (constant signal strength) 
This is the case studied by Knorr. 

(b) (equal receivers) x^(v) = 



(v) 



V for 

fl 



(c) (receiver threshold) Xj^(v) 



0 



= 1 . for all 

X 

all i . 
if V > Jl. 

— X 

r 

if V < £ . 

X 



i 



6 



where is the threshold limit for receiver i . 

(d) (fuzzy threshold) x^(v) = • v , where 

denotes the proportion of signals of strength v that 
receiver i would detect. 

By taking special forms of the distribution of V and the 

constants , it can be seen that (a) , (b) and (c) are all 

special cases of (d) . Thus, (a) results with V degenerate 

at 1 in (d) ; (b) results with 5,^ = 1 in (d) ; (c) results 

with = 1 and V distributed Bernoulli in (d) . Thus, 

we shall consider only the case (d) with various conditions 

on the Ji^'s and distributions for V . 

z 

For each zeS , let n denote the number of times z 
occurs in the data set (i.e., the number of times this partic- 
ular set of detects and non-detects, among the k receivers, 

occurred during the time period in question) . Let n be the 

Jc z 

2 -dimensional vector whose components are the n 's in some 

•k 

specified order , and let N be the random vector with outcome 

n , where n varies over N's sample space, say T. It follows 

that N is distributed multinomial with "number of trials" 

parameter s and "type z outcome" probability vector p 

z 

whose components p are given in eq. (2) . Note s is the 
total number of signals occurring, including the undetected 
signals, so s is unobservable. Symbolically, we summarize 

this by writing 
★ 

A convenient method of indexing the z's is to regard the 
components of z as forming a binary number, then indexing z 
with the decimal equivalent of that binary number. Thus, for 
example, 0 = (0,0,0,. ..,0) is indexed by 0 , ( 0 , 0 , . . . , 0 , 1 , 0 , 1) 

is indexed by 5 (since , and so on. 
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N ~ M , (S,p) , 

2 ^ 



I- 

where the 2 components of p are given by 




1 .1 

v)^ (1 - • v) ^ dF(v) 



and may depend on the £^'s as well as parameters in F (v) . 

We use this multinomial formulation in the maximum likelihood 
estimation approaches discussed below. 

4 . Intraclass Correlation 

It may be the case that the k receivers operate 
physically independently of one another and yet, because they 
all are subjected to the same signal "stimulus" at a given 
instant of signal occurrence, the receiver detection outputs 
are statistically dependent. This is analogous to intraclass 
correlation in experiments having random effects (see Scheffe 
(1959) ) . We are assuming receivers i and j detect a 
given common signal having strength v with probability 
(£^ • v) (£j ♦ v) . Recall and are Bernoulli random 

variables whose outcomes (O's or I's ) designate the respective 
receiver i and j detection or nondetection of the given 
signal in question. We shall show the correlation between 
and Z^ can be (and generally is) positive, so the receiver 
detections are not in general independent. 
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Now 



(4) 



Cov(Z^,Z^) = E (Z^Z^) - E(Z^)E(Z^) 



= Z.Z. I v^dF(v) - 1. I . 

^ 1 i. 11 



1 1 
/ vdF(v) 

0 



= I . a . a,, , 
11 V ' 



2 

where is the variance of signal strength, V. Similarly, 

the variance of Z^ is 



V(Z^) =E^(V(Z^|V)) +V^(E(Z^|V)) 

= E (£^V(1-£^V) ) + V(2,^V) 

= S,j_E(V) - £?E(V^) + £? V(V) 

= S,^y^(l-£^y^) , 



where y^ is the mean signal strength, with a similar expres- 
sion for the variance of Z^ . It follows that the correlation 
of Z^ and Z^ is 



(5) 



P(Z^,Z^) = 



a„/£ . Si . 
V 1 D 



y^/(l-£j_y^) (l-Jl^y^) 



= > 0 



If signal strength is constant, say degenerate at 1, then 
2 

0^=0 and this intraclass correlation is zero. On the other 
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hand, if signal strength varies among signals, then p > 0 
and the receiver outputs cannot be independent. It is useful 
to note from (3) and (4) the probability that receivers i and 
j both detect a given signal is 



( 6 ) 



E(Z^-Z^) = + yy) 



r 



= + TT^TT^ = TT^TT^ 

13V 



1 t ^ 
y2 

VI 



the latter quantity being related to the signal to noise ratio 
of the signal, V . 

As a specific numeric example, suppose V has a beta 

ct 

distribution with parameters a and 1 , so that F (v) = v 

2 2 

for 0 1. 1 3 .nd a > 0 . Then = a/ (a+1) (a+2) and 

= a/ (a+1) , so using (5) , we have for this case 

p(Z^,Z^) = /I^/(a+ 2 )/(l + a(l-£^)) (1 + a(l-Jlj)) . 



If a = 1 , so V is distributed uniform over (0,1) then 
0 ^ p £ 1/3, depending on the values of and between 

0 and 1 . (p - ,33 if £>3 a.re 1 ; p 2 .1 if the £'s 

are .5). If a = 100 (say), the distribution of V is nearly 

2 — 5 

degenerate at 1 (y^ = .99 and = 9.6 x lo ) , and the 

intraclass correlation is nearly zero (0 £ p £ . 01 ). 

In a model that assumes (and exploits) independence of 
the receivers, the presence of positive correlation can be 
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expected to degrade the estimates of tt and s (the vector of 
receiver detection probabilities and number of signals present, 
respectively) . The nature of the degradation depends on the 
particular situation and may be difficult to determine. It 
can be expected that the variance of the estimators, and the 
mean square error of the estimators, will increase if a model 
is used wnich ignores the receiver dependence if it is in fact 
present. It should be possible to get some idea of the strength 
of correlation among receivers by examining certain residuals. 

For example, suppose tt and s are estimated by it and s , 
using estimators which are derived assuming receiver independ- 

/N 

ence, and suppose tt and s are used to estimate the expected 
number of signals that should have been detected by exactly j 
receivers, for j = 0,1,2, ...,k. Define the residual by 

(7) R(j) = (observed number of signals detected by j receivers) 

(expected number of signals detected by j receivers) 

If one finds R(j) tends to be positive for j's near 0 and 
near k , while R(j) tends to be negative for intermediate 
j's , this suggests p > 0 . In such a case, the quality of 
TT and s may be questionable, and it might be prudent to use 
alternate estimators which accommodate dependence among the 
receivers . 
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5 . Estimation Approaches 



We shall discuss several approaches to deriving estima- 
tors for tr and s . Most of these require numerical minimi- 
zation techniques, which can be carried out with any one of 
several commonly available programs, such as GRG (Lasdon, et al 
(1975)). The approaches fall into three categories; Method 

of Moments, Least Squares and Maximum Likelihood. In all cases, 
2 

= 0 IS assumed in the estimation model, except as noted in 

the Maximum Likelihood approach. 

(a) Method of Moments Estimators. Let denote 

the nuiiiber of signals detected by receiver i . Then T^ is 

binomially distributed with parameters s and , so 

E(T^) = s • TT^ ; i = l,2,...,k. Thus k equations in the 

12 k 

k + 1 unknowns s, tt , tt ,...,tt are obtained by setting 

• /N /N • • 

t = STT ; i = l,2,...,k, where t^ is the observed outcome 
on the random variable T^ . To obtain a k + 1 ^ equation, 

let 



T* = ^ (number of signals detected simultaneously by 

i<j receivers i and j) 



so 



E(T*) = 



3 I 
i<j 



TT^TT^ 



1 + 



"V 



3 I 
i<j 



1 1 
TT TT-* 



2 ^ 

assuming = 0 . Set t* = s ^ tt tt-' and, together with the 

i ^ ^ i 

k equations t = stt ; i = l,2,...,k, solve for s and tt 
to obtain 
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8 ) 



s 







= f 



■t / I 
i<j 






(b) Least Squares Estimators. First, let us consider 
the method developed by Knorr (1979) . Let A denote the 
event [Z 7 ^ £] that a given signal is detected by at least one 
receiver. Recall t^ denotes (sum over all data vectors 

z) , the total number of signals detected by receiver i ; let 
t denote the number of such data vectors (i.e., the total 
number of signals detected) . Now might be estimated by 




t 



if P(A) were known, since t /t estimates the relative fre- 
quency of the event [receiver i detects] among those occa- 
sions for which the event A = [some receiver detects] occurred. 

k 

Similarly, let Z* = I Z^ denote the number of detections 

i=l 

made of a given signal, let denote the number of data 

vectors for which z = j , and let p^* be the mass function 
of Z* (positive at z’ = 0,l,...,k). Now P 2 *(j)» the 
probability of exactly j detections of a given signal, might 
be estimated (for j > 0 ) by: 

^ I j 

(10) p .(j) = . P(A) 

Z t 
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is a relative fre- 



"I • 

if F (A) were known, since again, 1-^/t 
quency which estimates the conditional probability 
P[Z* = j|A] . For the case j = 0, 



(11) p . (0) = 1 - P(A) . 

Z 



Now consider P(A) to be a parameter which can vary 

over the interval (0,1) . For each value of P (A) , and a given 

i • -i 

data set determining t , t and , one can calculate 

p ,(j) using (10) and (11) . Alternatively, one can estimate 

Z* 

the corresponding probabilities by first estimating the it 
using (9), then calculating the probabilities as functions of 

✓V • 

the TT^'s using probabilistic arguments (for example, see 
Knorr, 1979) . Denote the estimates determined by this latter 

approach by p (j) • Finally, form the squared error quantity 

Z* 

k /s 

(12) E^(P(A) ) = I (p . (j) - p . (j) )^ , 

j = 0 Z Z 



and find the "least squares" value 0 < P(A) < 1 minimizing 
(12) . This minimization can easily be carried out numerically. 

^ /N • /S 

Once P(A) is obtained, the are given by (9) with P (A) 

in place of P (A) . The total number s of signals present 

can then be estimated by s = t /P(A) . 

A variation of this, which might be described as an 

overconstrained method of moments with least squares fit, is 

as follows. As in the method of moments, set 
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= STT 



i = 1,2, 



,k 



This gives 2k equations in the k + 1 unknowns s , 



TT 



, since the p ,(j) 's are functions of the tt^’s 



(and we take P ,(j) to be such functions of the tt^'s). We 

Z * 

estimate s and tt with a weighted least squares, weighting 
each expression by the inverse of its variance. Now 

V(T^) = STT^(l-TT^) and V(I^) = sp ^(j)(l-P .(j)), so we wish 

z’ Z* 

to find s and ti minimizing 






: _ 



sp . (j) 
Z 



o 1 1 k , . i i. 2 k 

(S,lt^ , . . . ,71^) = I ~ *. + I . 

iil STI^U - TT^) jil <1 - P 



This minimization can be carried out numerically, using the 
Generalized Reduced Gradient non-linear maximization algorithm, 
for example . 

(c) Maximum Likelihood Estimators. Recall the 2 - 
dimensional vector N , whose "z;yi" component N^ denotes the 
number of times zeS occurs, is distributed multinomial. 



N ~ M , (s ,p) , 

2^ 

where in turn z is a k-dimensional vector whose components 

indicate detection/non-detection of a given signal with the 

corresponding k receivers. Similarly, p is a 2 -dimensional 

vector whose "z^" component, p , denotes the probability 

of observing such a detect/non-detect pattern among the receivers 
z 

p = P[Z = z]; zeS. Note this formulation imposes no condition 
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on independence of the receivers, although actual computation 
of the p 's in terms of individual receiver detection prob- 
abilities (the TT^'s) would involve such considerations. 

Following the development by Sanathanan (1972), the 
likelihood function L , evaluated at the observation 
(n^,n ,...,n , a (2^-1) dimensional vector (where we omit 

n^ , the number of signals that went undetected, since z = 0 
is unobservable) , is 



(13) 



L(s,p) 




. .n 



2^-1 



/ 1\ n 
(P ) 




. 0 

where s-t = n . It is convenient to factor (13) into a 
marginal likelihood for s times a conditional likelihood for 
n given s : 



(14) 



L(s,p) = 



(P ) 



s-t 



(1 - p'") 



r 



X 



n 






t 




/ 

(c ) 




= L^(s,p°) 



X 1^2 (p) 



f 



where c^ = p^/(l-p*^) . Sanathanan considers both the maximum 

likelihood estimators s and p maximizing (13) and 
conaitional maximum likelihood estimators" s and p , where 
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p maximizes ^ 2 (p) and s maximizes L^(s,p ) . In this 

situation, it is known that, once p has been found, the 

solution for s is given by | (t /(1-p ) , where | (x) 

denotes the greatest integer not exceeding x . 

2 

In our model, with p given in equation (2) , the 

conditional m.£.e. approach will involve maximization of the 

second factor in (14) over a (k+m) - dimensional space, where 

m is the niomber of unknown parameters in the distribution of 

signal strength, V . We shall concentrate on two special 

2 

cases: one in which = 0 , so V can be considered to be 

degenerate at 1 ; and one in which V is distributed Beta 

with parameters a > 0 and B > 0 , as in our earlier example 

In either case, the maximization can be carried out with a 

numerical minimization routine such as GRG . 

Case 1: V degenerate at 1 . The conditional likeli 

hood function L 2 (p) is a function of k parameters, 

, since in this case the receivers are independent 

and, by (2), = H (l-£.)'^ for z 0 . (For 

i=l ^ ^ 

» k 

z=0,p=l- I p^=l- n (l-£.)) . Once the n 's 

z^O i=l ^ 

(z 7 ^ 0) are observed, t* = ^ n^ is known, and L- in (14) 

z^O 

is a function of . Note in this case , so 

the individual receiver detection probabilities are estimated 

by the 1. , and s = (1-£.)) . The numerical 

^ i=l 

maximization of L 2 in this case is over the k-dimensional 
space of £^'s . 
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Case 2: 



V ~ Beta (a, 6) . In this case, equation (2') 



gives 



(15) 



P = 



B (a, 3) 



.1 n 
J[ 


i 


, i 


(t.v)^ (1-l.v) 


0 


X 


X 



a-1 , , > S“1 j 

V (1-v) dv 



Now for each trial set of and a , 3 in the numerical max; 

mization of L 2 in (14) , the p 's can be obtained from (15) 
by numerical integration. Such numerical integration thus 
becomes part of the process of evaluating the objective function 
at each stage of the numerical maximization; this maximization 
would be over the (k+2) - dimensional space of the £^'s and 
a, 3 . As a special case, if 3=1 and the receivers are 
identical (the £^'s are the same), the p 's in equation (15) 
can be obtained explicitly as an incomplete beta function: 



z k“ z ct ~ 1 j 

p = (tv) (1-tv) av dv 





+a)-l 



{1-lv) ^ 



+D-1 



dv 



= Bit; z +a, k-z’+l) , 

I 



where B(x; a,b) is the incomplete beta function with parameters 
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a and b . This function is available as a subroutine in many 
computer installations, so a separate numerical integration 
routine need not be called in this special case. The numerical 
maximization of L 2 is over the 2-dimensional space (£,a) in 
this case. 

6 . Testing the Model 

A chi-square test of a model for the signal detection 
process can be made in cases where the maximum likelihood 
approach is used. This can be applied, somewhat more approxi- 
mately, when conditional maximum likelihood approach is used. 

This test can be used, for example, to investigate whether the 
receiver detection probability model (x^(V) = with V ~ F 

and "conditional independence" of the receivers) is plausible, 
in light of the observed data. In particular, with V degenerate 
at 1 , it can be used to test the plausibility of the assumption 
of receiver independence. 

2 

The test is conducted as follows. Once the p and s 
have been estimated, the expected number of outcomes of each 

^2 ^ ^ Z 

type z for zeS can be estimated by E (N ) = s • p , and the 
test statistic 



t = I (n^ - E(N^) )^/E(N^) 

z^O 

computed. Under the hypothesized model, t is (approximately) 
an outcome from a chi-square population with (2 -1) - (m+1) 
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degrees of freedom, where m is the number of parameters esti- 
mated (i.e., the dimension of the space over which the numerical 

maximization was conducted) . As usual for chi-square "goodness- 

^ 2 

of-fit tests, if some of the E (N ) 's are less than three or so, 
these "categories" should be pooled with others so the three or 
more expected count rule of thumb is met, with corresponding re- 
duction in the degrees of freedom for the test statistic. The 
level of significance of the test is the tail area above t , 
under the appropriate chi-square density. 

7 . Comparison of the Estimators by Simulation 

CAPT Dave Hendrickxis currently conducting a series of 
simulations to evaluate and compare the behavior of the esti- 
mators described above, for a variety of data input streams 
related to the general model x^(V) = , with 

V ~ Beta (a, 1) . By varying a from 1 to 100 , varying 

degrees of intraclass correlation can be generated among the 
simulated receivers. As mentioned above, with a 100 , the 
receivers are essentially independent, since V is then nearly 
degenerate at 1 . On the other hand, v/ith a = 1 the signal 
strengths vary at random over (0,1) , and there is appreciable 
intraclass correlation among the receivers. Details of the 
simulation and analyses of the results will be published in 
Hendrickx's masters thesis, Hendrickx (1981). 
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Preliminary analyses of results from a limited number 
of simulation cases suggest the following conjectures concerning 
the three estimation procedures : 

1) it is not the case that one of the procedures 
dominates the others over all situations; 

2) generally speaking, the maximum likelihood esti- 
mator has smaller variance than does the method of moments or 
least squares; 

3) all procedures appear to underestimate s and the 
TT^'s when the receivers are made dependent by taking a as 
small as 1 ; and 

4) the estimators perform generally surprisingly well, 
even when the total number of signals s is as small as 25 or 
so, without regard to the number k of receivers or the mix 

of TT^'s , when the receivers are (at least nearly) independent. 

As remarked above, these are preliminary observations; more 
details will be documented by Hendrickx. 
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Appendix 



LIST OF SYMBOLS 
(in order of occurrence) 



k: number of receivers 

s: number of signals 

■Tj_j : probability receiver i detects signal j 

Vj : strength of signal j ; ~ F (v) , E(V) = Py t V(V) = 



T.(V.) = TT.. = t . 

ID ID 1 

Z = (Z^, . . . ,Z^) : 



' V . 

D 

vector of Bernoulli detect/non-detect 
indicators, for a given signal, for all 
receivers . 



TT^ = p[z^ = 1] = E(t^(V)) = 
S: sample space of Z . 






p = P[Z=z]; zeS 
z 



n 



number of times zeS occurs 



, 0 1 2 ’^-!. ^ . z, 

n = (n ,n ): vector of n *s 



n 



z = 0 



= n 



, 0 1 2^-1. ^ . 

p = (p ,p , . . . ,p ) : vector of 



z I 

p ' s 



in some specified order; 



in same order as for n 



N: random, vector with outcome n ; N ~ M , (s,p) 

2^ 

R(j); the residual; R(j) = (number of signals detected 

by j receivers) - (expected number 
of signals detected by j receivers) . 

: number of signals detected by receiver i (outcome is t^ ) 

T*: \ (number of signals detected simultaneously by receivers 

i<j i and j ) 

A: the event [Z ^ 0] 

^ ^ i i 

s, TT : estimates of s and tt'^ , respectively 

t : number of signals detected 

Z = ^Z^: number of detections of a given signal 

i 
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for which z 



p . (j) : mass function of Z 

Z ' 

: number of data vectors z 

L(s,p) : likelihood of N at n 

i i / / T 0\ 
c = p /(1-p ) 
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